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An algorithm i a presented tor rtsteritining the value* which 
simultaneously satisfy a Bet Of relation*, nr cone train la, Involving 
different sufceeta of n variables. The relations are represented in a 
serlett Of Constraint networKe* which ultimately contain a node for every 
subset of the n variable*. Constraints may be propagated through *u£h 
networks in (potent ia I II y I parallel fashion to determine the values which 
simultaneously satisfy all the cooetra i nla. The Iterated constraint 
propagation serves to mitigate combinatorial explosion. Appll call one in 
scene analysis. graph theory h and backtrack search are provided. 
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1. Satisfying simultaneous tonstraIntsi problem and applications 

i-le ara given a set nt variables Kj,.H,K n and Constraints on subsets 
of those variables limiting the values they can taka cm. These constraints 
taken together constitute a global constraint which specifies which sets of 
values a^ + ,.pjg n for X| f ,., P K n can simultaneously satisfy all the given 
eonstraIntftp In Other words, the constraints define an n-ary relation. 
Our problem Is to synthesise this re at ion, i.e. to determine those sets of 
values which simultaneously satisfy the set of constraints. 

The simultaneous satisfaction of several conslrgints--cali them 
properties^ relationships, predicates, features cr attritautes--Is a very 
general problem, with more gppl i cat Ions then ] can fully survey here. The 
essential technique he apply f I terpted reduction of possibilities through 
constraint propagation, has analogues in nany areas of computer science and 
mathematics. ' Many of these applications and ana I agues are described In 
E15J , CH3 a no \ 2 <*\. Applications range from data bass retrieval tfind aM 
x, y and i euch that k It 9 pert and y Is a part, and j Ij fi supplier, k 
must be installed before g, and £ supplies both n and yl I see also [121 f tD 
scene analysis (segment the scene Into regions such that sky regions are 
blue, grass regions are green, and car regions are shiny, sky regions are 
above grass regions and car* are not totally surrounded by either grass or 
sfcyl. Qf particular note is the work «F j,R, LH iman, uho has used 
constraint propagation if a thuds In a variety of contorts, ranging from 
pattern recognition [131 to graph isonorphiar* [211. The problem alec 
admit* of a graphical represents!lon T where Its reBsmblance to networks of 



interacting procesie* conjures up 3 lung history pf : oth*r work, I no 1 ud 1 ng 
recent Iyt [81, US) and [@J< 

In seen* anaIysla, rn particulars thera haa been a recent groundsuell 
of applIcstlons, e.g. m* QS] . fBl ► E1B3 F Several df the latest anaoples 
can be found in 13] * 

CHten art only given, or choos* to use, H lpcaC* constraints, 1.o+ 
constraint* on small sudssts of the var iidles, from which He must 
synthesize the global constraint. For t u*n d .tm n n t g ! results on the 
comp I omont ary problem, analysis of a global constraint Into local ones, see 
El 4] , 

2 * Previous resultsi partial consistency , 

Constraints represented In network form nay Pe propagated through 
tpotentiaIlyj parallel algorithm* which Cut down the solution search apace 
by ruling out income i stent combinations of valuta. 

The obvious brute force approach of testing every poenlble combination 
Of values faces an equally obvious combinatorial explosion, Backtrack 
search techniques cut down the search Space but often exhibit coat I y 
■thrashing* behavior E17f 12), hackuorth Ell} has interpreted previous 
work by Pikes C71 + Ualts E23] and Mpntanarl HSl a* cutting down the Search 
space and avoiding desses of thrashing behavior by eliminating 
combinations of values util oh could not 3 p peer together in any set 
satisfying the global constraint. 


A natuorfc repr ese-n t at i on of a set c>f (innj ( r a 1 n to ig employed 
(reHtrieted to unary and binary constraints,, predicate* on She or tuO 
■variables], Each variable is represented by a coda, and each binary 
predicate by a link or are between two nodes. (Loops or a nods may tie 
viewed as binary or unary prad I eat**, 1 For onadpla, thn problem of 
CO I Or I ng a tub rode complete graph with era color car be represented a a in 
Figure 2 * 1 * 




figure 2,1 


In the -flgura, fred green!| and Ired greenly »re thn initial delaine of 
valuee for )£^ and respectIvaly, the predicate at each node 1 * "colored 
red" and the binary predicate between the nodes ll "5* rot the earns color 


flaekuorth dIetinguiehee three level 9 of incon*ieleney for a constraint 
not^uorh,, which represent comb i net Iona OF valuog which cannot participate in 
any solution to the global constrBint* Ihe first and host oOvicue io rede 
i ncone i etency. Here the potential domain of values far and Kj i a given 
as red and green, but the unary prsd‘cateS specify red. We can immediately 
eliminate green fron Path nadee* aa in Figure 2*2* 


( ' Ired 


tred I'D 


Figure 2,2 





Ths ftHKt level of Ineonalatancy is arc inconaistency, the -arc from X^ 
lo Kj In Incgnelatent because for a value in Xj, namely "red"’, there does 
not BK'ot sny value a2 in X^ such that red artel 3* together eatiSfy tha 
relation "red t* rust the sars color as a^*, To remedy this I noons \ e tsney 
ue remove red frtwi X^, and similarly, from Xj, Thia cute down our March 
apaoe all right* unfortunately. In this case It ref I acta the fact that the 
pro&iee U I mpaaaibIB. There I s no gI coal solution. La. the netuork la 
uhat I call ‘-unaat i ef iable'. 

Jt ie entirely possible for a nstnork to hava no arc inconsistencies, 
and still he unsat ref i ah I e.. Consider tha problem of coloring a complete 
three node graph with tun col are. represented in Figure 2+3, 


I red green) 7 



Figure 2 .3 


Abbuwb the set of passible values for each variable ie Ired green) and th* 
binary predicate between each pair again specifies 'is not the aa-m color 


Thia network Is arc consistant, s,g. given a value *rad M for Xj, ue 
can choose ''green* for X^: rad is not the same Color a a green. Vet 
obviously thera la no uay of choosing einyls values a^ t a ^ 1 a^ T tor X j, Xj + 
and X^, such that a] I three binary constraints are satisfied 
Simultaneously, If ue Choose red. For Xj, for example, hb are forcaiJ to 
Choate grasn for X^. to eatiftfy tha canatralnt between Xj and Xg, This 



forces £ choice of red for uhich farces a choice of graen for 
already picked to be red. 

Nevertheless* It may be helpful to remove are inconsistencies from a 
network. This involves comparing fiOdel M11h- their neighbor* as ua dio 
above. Each node meet be so compared; heuaver, comparisons can cause 
changae (delations} in the network and 90 IhO comparisons must be “Iterated 
until a stable network It reached. These itarationa can propagate- 
constraints acme distance through lha Hit work. TKb conpariBans at each 
node car theoretically da per farmed in parallel and this parallel pas a 
1terated. 

Thu a removing are Inconsistencies Involves several distinct ideasf 
local constraints Jr® globally propagated through iteration of parallel 
local operations, It nenain* to bs seen uhiah aspects of this proucun are 
boat -significant to Its application* The parallel possibilities may prove 
to be particularly Impart anti however, at the Moment serial 
implementations are used In practice. 

UaHz “filtering" algorithm for score labelling L23J Ib the paradigm 
example of an arc consistency algorithm. Haiti H>6h99 to attach labs I a to 
the lines in a lino drawing indicating their semantic interpretations as 
eonve*, concave or occluding three-dimspaional edges. The line drawing 
Itielf functions' as the constraint network. Vertices function 39 network 
nodes* An individual vertex value consists of a label for each of the 
lines irooidsnt to the verte*; the sst Of possible vaiuss is initially 
constrained according td realizable three d 1 *1*091 OhSf interpretations far 
the various types of vertices. The lines a^s the arts of I he netuprk and 


each represents the relation "(he label lings of thi adjacent vertices must 
agree along this lire’* 

Ualti filtering algorithm {especially when further cone trained by 
specify Ing Initial labels for edges on the background) general Iy results in 
en amazing combinatorigI reduction] thousands Of pessid I i I 111 es are often 
r-educedi to a state where ell nodss have a single value remaining, thus 
tetellg sowing the problem «jf obtaining the global solution. Of course 
the algorithm does not always terminate with a unique value at each node, 
Generally, in this case, meet nodes ull l still have a unique value, while a 
feu nodes mil have a shall sat ef values regaining. Normally this final 
state indicates that several ambiguous interpretations aro possible? 
a l tsrnat i va sets of values that si mu I tareouij iy satisfy all conatrainta can 
be Quickiy found with tree search. 

[t is perhaps not ae well appreciated that this final elate may also 
be reached for a figure which in fact adults na consistent labelling. This 
Ib to be Suspacted, however, given that the filtering algorithm only 

I- 

achieves arc epos latency. Given the baaic Huffman label sat f 101 141 (not 
Waltz’ expanded label set) and applying the filtering algorithm (without 
first constraining the outside Unas to be occlugipnel, th# line drawing in 
Figure 2,4 is left labelled ae shewn. 


+ 



However, there It no- consistent choice Of labels for the vertices of the 
I] nnar triangle. In oth#n ifOird? the filtering a Igor l the ■alone will inot 
di tor-sine if a line drawing is whit Hof (man cilia an " impose I b I e figure 11 , 
hcmtanari [151 ha# developed a more pcuer-ful notion: of inconai etency 
which HackKgrth tilli path Inesnii (twey, A network is path inconsistent 
if there are two- nods* and ^ such that a eatlilies o eatii-fiei *2* 
a and, b togather satisfy the binary constraint between them, yet there Ip 
some other path through the network fron to X^, aueh that there is 
set of value it one fpr each node along the path, which inducfiS 3 and b, 
dntf car a i InW I tihiOUS I y satisfy all constraintI along the path. For- 
e^aeplBt the hit work In Figure 2.3 is path i nconsi 0 tenti red aSlLiflea 
green Kj, hid I# not the sane color as grgsni however, there i# no value 
for ^2 which wifi satisfy the con#traihti between and )(£, Wld between ^2 
and while Nj I# red, X^ 1# green. 

rtcrtanarl gitf## an algorithm that essentially removal b 3 th 







incon* 1 *tenc 5bb from a nsluorK, Hohbvbt, pith con* ■ a tency doe* not 
necesearily insuns gat i*f■abiIity either, as powerf-u 1 a* it Bounds. 
Con aider the prodlorn of coloring the conpieta four node praph ul th three 
colors 1 Figure 2.53 . 


(r q bk ^ 



(r g bkj 


Figur* 2^5 


Each nod* contain* red, Breen and blue, and Bach arc again represents the 
relation "i* not the seme color a*". ]n particular, path cons potency does 
not fully determine th® set of values satisfying the global constraint, 
Hhich in thie inconsistent cess is the obpty set, 

]n summary, ere and path consistency aigerithee may reduce the search 
Space, hut do oat in general fully synth®* iz® the globai constraint* When 
there are aultlple solutions, additional search Mill be required to opacify 
the several acceptable combinations Of values. Even a unique solution nay 
require further search lo dot Sr sine, and the consistency algorithms may 
even fail to reveal that no so lull on* at ali n k i nt, 



3, An flHtended theory 


As tht coloring problem suggest a, the general prohlEH of syrfhee I z i ny 
the glob®I constraint ifl MP-cohpletS [5], and thge unlikely to have an 
efficient (polynomial t i me 3 solution* On the other hand the Experimental 
results of Haiti, and the theoretical studies of flontOngri, auggssl that in 
epeqifi g applications it nay be possible to greatly f&£* 11tnte the anarch 
fpr solutions* I ul I I present am a I aot- i tHiTi for synthes I Z i ng the n-ary 

constraint defined by a set of constraints on subset s of n variables. L t 

1 

may be of substantial benefit Ifl applications where pruning Ot arc and path 
Inconsistencies still loaves hany poe*lbiiltlee to be searched* 

There are two key observations that motivated the algorithm* * 

*! 

U Mode* arc and path CortsiStshcy In a constraint nstuork for n 
variables can be general i zed to a concept of k-ccnaIstsney for any kin* 
Uherft n-consletency const!tutss a natural notion of global consistency. 

Zt The given constraints can be represented by nodes, as opposed to 
links* In a constraint network; us tan add nodes representing It-ary 
eonetraints to a constraint network for all kin (whether pr npt a 
Corresponding k-ary cons tra lot is g> vents Shd us pen then propagate these 
COflB trainto in this augrisnted net to Obtain higher level a of consistency* 
By successively: adding higher level nodes to the netuork and 
propagating constraints in the augmented net, we can achieve k-ary 
consistency for all k. We do not need to restrict the given constraints to 
binary rolations, Ruling out loner order iboon *>9 tendss in stages 
progressively reins In the combinatorial explosion. The final result lo B 


globally Consistent network, where the n-ary node epecit I s* explicitly the 
n-ary conetraint ug seek to Synthesize, Mo further search 3 g rSquired. 
The rest of this paper will present the algorithm* along ul th a sufficient 
theoretical baas to justify its operation. 


4, A preliminary example c> the synthesis algorithm 

I uill give 0 crude sample Of the synthesis algorithm In operation, 
by way Of mot i vb t i on for the foreal description which foNoue. The 
presentation in this section i* intent I ana I 1 y sketchy. 

Suppose ue ara given ths following constraints an variables X^. 

X^* The unary con*Iraint specifies that Xj nw#t he either a or b, i.e. 

C 1 - la &i * Si»l l&My £2*1# II flhd Cj-lc d gl» The binary coretraimt on Xj 
end. *2 specifies that either Is b and Xj is e, or X^ is b and X^ le f: 
C^2 m la ® hf I, Likewise Cj^-lbc W bgl and ^ 23 “ r#:ef 

Ue wish to determine what choices for Xj, K^, X^. if any. can 
simultaneously satiety all these constraints. Ue begin building the 
constraint network with three nodes representing the unary constraints on 
the three variables, as shown In Figure 4.1. 

1 e fl z 
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Figure 4.1 


Newt we add rnjdea representing the binary constraints., and link them to the 


unary constraints as shewn in Figure 4,2 (a.y, Eba bfl^ r ®P rflBen ^® 
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Figure 4,2 


After ur add and link nods Cjj ue look, at node and find that 
d I Ghent 3 doea not occur in any mender of Cjj, U ft delete a from Cj. 
Similarly, Vi a delete c from after adding: Cjj- The constraint ns [work non 
abb«^ r i as in Figure 4 . 3 , 
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Figure 4.3 


N&W from Cj we look at -■ and Find that there is an element be In 
which requires c ai a value tar X^, white c ie no longer In Cji We remove 
be frem as in Figure 4 , 4 , 
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Figure 4.4 


So fan me have merely achieved a sort Of "are ccrsl ■ tency" (though MO 
indicate the restriction of the pair Dc h at mb!! as the elements a and cK 
N«y t, ue add a nods for the ternary constraint. He order three 
constraint was given originally T so we could assume initially the 
"non-constraint" h all possible triples. ttowevsr, ue will take advantage of 
the restrict lone available frcH the binary and unary predicates to 
construct a mors limited sat of pass I bi I i t ies. Snd Cj-j together allow 

only the fallowing set of triples: (bad bfgl , Uo uss this as the ternary 
node and 1 ink It to the binary nodes as shorn In Figure 4.5. 
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Figure 4 .$ 


Ur look at the new nods from Its neighbors and vice versa, as ho did 
earlier, tc Insure consistency of the sort we obtained earlier between 
neighboring nodes. Is consistent with the new nods: fed is pert of 
bed, bg part of bfg. Similarly ana C-^ are consistent with tht ternary 






node, !f necessary, u? coy Id propagate delations around until local 
con* i etency ie achieved on thi* augmented net work. However., In thie case, 
the ne-tworh la already stadia; r*p further change* are required. 

the ternary node represent* the synthesis of the given constraints. 
There are two ways to s I mu I tpneoMtl-y satisfy the given constraint 9 : X^-b, 

X2* i| Oi X'jw’dl dr- j mb h X^^y-., 

5, 5aaic definitions* constraint expressions, Constraint networks and 
satisfiability 

This section present* several definitions needed la stats the prod lea 
and its solution precisely, 

U* are giver a set of variables X]_, + . + ,X n which may take on values 

from 3 sst af universes respectively, Ue will assume the U| to 

he discrete, finite dams In*. Let Ml Z H>, Many of our definitions 

u * M be made, for any subset j£l , Us denote by Xj the indexed set af 

variables (X^l If ^ value a j ip ki I i be cal led an ms t an t i a 11 on gf 

■# 

Kj, An instantiation of a set of variables Kj, denoted by a js '* a on 
indSitfcd set of values 

A constraint on Xj, denoted Cj, I* p eet of instantiatSane of Xj, 

hg "ihdexed esf notation Implies that there 1* a function., a, fro» J 

ante- the ■ netaa 11 at 1 on aj, which servos to indicate which «ember of aj 
in* tartlet#* which variables the value of a at j, denoted a^ H le the 
i he tantiation . of X^, Ue could also repreeen * \F a* an erdtrotf tnst or 





to- tufj I a , Uhere *1 is the number of elements In th* gat J leal led the 

cardinality of J and denoted |J|U aj-ta..a. J T 3 , In U = , > = -e|^ 

for l<k, i H k-1 1 , , h , fn. Thus Cj nay ha thought of as an q-ary relation. 1 

hava found It useful, however, te was set notation rather than refer to 

cross products or predicates in the presentation uhich foilowg. Given a Jt 

ui,f ths Instantiation at X- Contained In aj. 

A constraint exp-esgign of order r It a conjunction of constraint) 

O ^ Cj, one constraint for each subset J Of I (sKcapt the anpty subset). 
Jt2 ] 

Normally ue Mill hot on explicitly given constraints for dll Jett 
however, up C&n aesum* they uniat, with no lots of generality, as the "non 
constraint" for Xj can a I ways b) sped fled, the sat of all Combinations pf 
elements from the domains of th* variables in Kj, 

We say that an instantiation aj satisfies g constraint Cj If OjtCj, 
The Instantiation dj satisfies a constraint C^, ttfij, if the set 
,Jfl 'Ch ms call aj restricted to H, is a member of C||, An 
Instantiation aj, where |J|*k, k-satiaf ies a constraint expression of 
order nik If dj satieties the constraints C H for ill HcJ* If an 
instantiation 3| n^gatiefiss ths constraint expression- of order n, mb say 
that setiafies the expression* A constraint expression C is 
k-gatisf iable if for all cardinality k subset) J Of I, there exists an dj 
such that aj k-satlsfios C. If C of order n 9e n-s3tisfiabIe It 1® ggi-d to 
bo satisfiabIe . 


A conjunction of constraints, a constraint exprggsion, defines another 
cons Ira i n t: the set □( all instantiations d[ uhich satisfy |h« constraint 
expression. Our central problem is to synthesize ths order n constraint on 









K| defined by the constraint B-Kprsaslem. U*, t-o determine explicitly Ih* 
set flf i na tantiat i ons 3[ which siiml taneouBly satisfy all thfl ylven 
constraints, An Instantiation Sj which eatl*fi«* C I* called S solution of 
the constraint e^prnssion. 

A constraint network of order k in n variables, k£n, is- a set of 
cons tra int 5 cal I ad nodes, Nj„ tor each JC3 , |J|iK, where g 11 nk is said to 
twist between Nj and if HfiJ snd | H | -1J1 -t* Linked nodes are called 

neighbors, A constraint network of order n In n vgripbleB will be oaf fed a 
f u j | constraint network. A nods Nj is said to correspond to a given 
constraint Cj if Nj-Cj„ i.e. each instantiation of one is a nemper of the 
other. A fyU constraint network in n variables corresponds to a 
constraint a*prefielon of order n if each nod* Nj in the network 
corresponds to the ton* Ire Ini Cj In the expression. The Order of a node 
Nj, or a constraint Cj, is the cardinality of J. 

For example, the network in Figure E.i corresponds to the constraint 

expression C« ^ Cj , Wherei 3 “It Zf , Cj"!r g3 ■ ^ 2 " [r g] , G|2"i r 9 fl r ^ * 

Ji2 l 

(1 avoid set notation in the subscripts for aibp Iiti ty. ] 

fr -irg gri^ - ir B>£ 

FI gyre 5,1 

This I* oftvlsgely a representation of the prOtjlen of coloring a two nod* 
graph with two color*. 

A* nodes are constraints w* are able to restate ail the above 
definition* involving satisfiability in terms 0-f nodes and networks, rather 








thin constraints and con s tr a I n t ewprgBaians. 3 n par then tar *jij can- apeak of 


an instantiation aj satisfying a neds far HtJ. Ue also h 1 31 uant to 
talk about aj aati string for MoJ. Us mil 33y that 3j Batiafiaa N^* 
H^J, if there exists an in such that la j ta^\ . j-a j„ kt^ there is an 
instant ■ a t i on which satisfies whoso restriction to J ia aj. 


£. Constraint propagation 

l 

He can new de+lnt the oaaio constraint propagation mechanism. To 
local Lu propagate tha constraint Nj to a neighbor irg cohitraiflt N H , remove 
from a It which dp net satiety Nj. Global propagation la defined 
recursively,. Te g I gba Mu prod Beat a a constraint Nj through a neighboring 
constraint N^i first locally propagate Nj to N^t then* If anything was 
removed from. by the local propagation, globally propagate N|^ through all 
its neighbors except Nj. To propagate a constraint Nj* globally propagate 
Nj through all its neighbor a h Tha propagation procedure is similar to an 
arg consistency algorithm, flackuorth discusses efficient serial algorlthma 
far arc consistency (11K Of Course, a parallel implementation is 
poeeibIe. 

A constraint network if said to be relaxed if we can propagate every 
Constraint Hj in the netuork without causing any change (deletions Teem 
nodes! in the net. The r o I 3*3 t i on of a cone train t network is the nelwork 
obtained by propagating all nodes of the network. (The propagation 
obviously terminates In a related network*3 









7 + Synods g-i gor 11 hn 


Ue are row ready to a tats the synthesis algorithm. The clsiw* to be 
proven in section 10+ is that thi b algorithm, given 9 bona t r 9 > M 
expreaeicn, produces a conatraiflt network whose Os-dSr- n ncdd corresponds tp 
the order n conetraint defined by the Constraint e*pr#?i e | on, 

ALGORITHM] 

Given C- A Cj, Ur define the algorithm inductively: 

Jt2 T 

STEP It Construct a constraint network with nodes Hj corresponding to 
constraints Cj In the givsn constraint expreeslon, for frl I Jcl of 
cardinality oh*+ 

STEP Mlt For alt JCt of cardinality kf-lt 

Add the node Nj to the network correspond i ng to the given constraint 
Cj+ Link Nj to all such that H is a cardinality k subset of J* 

Local ly propagate to Nj from each of its neighbors. Prop agate- Hj. 

For a conatraint expreasion of order n, the algorithm is ryn ter n 
etepe. The result ia a foil constraint network, where N[ corresponds tb C. 

The next sect ion will present several examples Of the- algorithm in 
operation. First a few general obser vat i ena. The network produced by this 
algorithm is the relaxation of the network correspond I ng to C, Me could 
have obtained It eImply by building the corresponding oroe r n network and 


prop? J9 |ing each nods* By proceeding in * I apes we take advantage- of the 
elimination of possibilities the I may occur at each stage to mitigate 
combinatorial explosion, LJe taka this principle further and propagate oath 
node as It la added, before adding another, ft good heuristic you Id be to 
add aarliar those fiodBB yhich inert a heavy Constraint, e,g. where Cj is 
smalL Ihfl propagation of those Constraint* may eliminate elements fro* 
oodee used in constructing later constraint*, If Cj is the non-ccmstra rnt 
i+b can construct IV^ initially from some and Nj_u, where H ie a 
cardinality k subset of J„ prsfsrabty the one for uhich INjJk|NJ Is a 
minimum. (fttfd to Bach member of each member of 

Other refinements are cleariy possible. Provision should be made for 
early termloati on, ft. y,. ->□ soon ae one node be cones srtrfi t y. Preparation can 
0* simplified* Sh Q* by opting non-ConstraIntt, or using complements of 
nodes* ftddiitlonal links could pare It dirsot propagation between a node Nj 
antf the node* for a I I eubee ti of J„ 

It ie aensrailu redundant to require all non-cone fraint nodes; 
basically uit only need one "path” up to the n-ary node for every Veal 1 * 
constraint, Consider a constraint expression on four verifies where only 
the Pinery Constraints ar* really specified tfha others are 
nan-cons tra i nts) . Dnty th* binary core t re 1 n t e can really have any effect 
on the global solution. Three ternary nodes are sufficient for the nefnork 
constructed by tbs algorithm. If the fourth ternary node rules out any 
element of the order four node,, it is oniy reflecting a binary constraint, 
uhich Is reflected in one of the Other ternary nodes* Gn the other hand! we 


may be interested In the effect* on non-conetraInte of the propagation 


process^ lo general th* pruning precede of the algorithm progress I ws 3 y 
ir-.ak.EB Explicit at Nj r*»tr 1 Ct iflOE on instantiations of Xj that are not 
originally given by Cj, but re than implied by the Other cone Irai Me. In 
the final network produced by the algorithm every member of suerjy Nj i® 
part of some ablution of the constraint eKpreaBion, (In particular, we 
have daHved the "mini bar network, flontanarra "central prohibit" 11SJ , I 


S, Further aw amp I be: graph coloring. scene labelling, graph i eoln&rph.l e« 

As the synthesis problsi* ie such a general one, the ayn the* i S 
Mgcri t hit has many potential applications, Graph problems, of couroe, lend 
them-seIves particularly to a COhitrsint network forrulation. ] prOSeM In 
th i a a e q t i on three ap pi I C a t I 0 n » uh i c h wilt serve to Illustrate t he 
algorithm, and Ore of aoma independent Interest as well* 

As wa would expect froh the discussion in section 2, the graph 
coloring prohibit can easily be represented ae a conatraint network. Given 
a graph G, and a set of col ore, ue cone true t a constraint network from G as 
follows* Each hods of G Is rap laced by the unary conetraint representing 
the set of colors. Cf there ie an Odgo ha tween nodes In G, we replace it 
by a binary conatraint linked to the nodo* which represents *ie not the 
earns color as", [f there ie no link between nodes in G, we add I ha 
nor-conatraint between the nodes. 

Lat us cafieider two ewahplos. First consider the probleh dt coloring 
a complete three node graph with Ihrae color a. Figures 8.1a, 8,1b and EL 1c 


show the constraint net nor k aH*r steps one, two and thren of the 
algorithm, where ths nodes N a are ail the set fr g b), Nj 3 and 

W^3 aH equal (rg rd gr gb Ur bgf and Njjj" Lrgb rljg brg bgr grb gdrJ t the 
elw possible colorings. 


N 


l 



a.i c 


Figure 5.1 

Ufl- could Construct a network uf the sort un used <j n sect ion 2, for this 
proxies. However the network would be pslh conslitenti arc and path 
C*fi9.i Stfthcy algdrithms would npt rule Out any elelrsnts at ths nodes. 

Consider now the problem Of coloring a complete four node graph with 
throe Colors, which we uaed in section 2 to Illustrate that path 
consistency is not a sufficient condition for satisfiability. AftSr tho 





third 8 tap of the algorithm ue uguld have four ternary nodes, each oqyal to 
the ternary node in the previous example. 

At the teg Inning af the fourth step ue usd and to construct an 
order four node* N^ 2 ;^rg&r rgdg rg,bb rbgr rbgg rbgb brgr brgg brgb hgrr 
bgrg bgrb grbr grbg grbb gbrr gbrg gbrbl, 'Local propagation from the Other 
ternary nodes quickly reduces the order four node to the empty set (and 
this constraint prppagates back doun to rsnove all element* from all the 
npdeaK No instantiation of th* order four node will slBultanBouely 
eatiefy the tour ternary nodoe* linsatIafIabiIity I 9 demonstrated. 

These examples are rather perverse ca*BB h of course, though they do 
illustrate points ul th respect to the discussion in section 2. Applications 
in the scans labelling domain generally involve more propagation than 
occurs in the coloring problem. The synthesis algorithm dOSS function as a 
teat for Impossible figures* It also find* all the Interpretations In an 
ambiguous figure. Vou may, h3tiI to simulate the algorithm on a simple 
figure I ike that in figure S.2- 



After the Waltz filtering algorithm Is run on the Huffman label set 
tui thou| additional constraints on the background labellings) there are 
three labels left at each order two vsrte* and tub at each order three 


vertex. 




For a final eHsmple, ue take graph leomarphi em. Cl van t m□ graphs C 
anti H. which we wish to teat for Ieomorphcsm, conetruct a constraint 
network from G at foil out. 11 f H hat to-a node a than G the algorithm will 
soak isomorphic napplnye of G onto apograph a pf H, I Replace each node qf Q 
with- a unary constraint nods containing all the nodes of H 4 (It »n allow 
loops, edge a from a node to i tae ■' f, the unary constraint on a node in G 
with 3 loop Nil I he "hep a loop in H\ qn a ngd* in G ulthpot S loop t *has 
no loop In H* * Ua could a loo incorporate additional unary constraints such 
as the order of the vsrtaH [22] J Replace each edge between nodes 3 and b 
In G with a binary constraint nods, linked to the unary nodes for a and b* 
This binary node will represent the conatralnt *tha&e two Idistinct) nodes 
share an edge Id H H t In other words the binary constraint will contain a 
pair *y if and only H there le ah edge between H and y In H, Between tug 
nodes which do not share an edge In G us alao place a binary node, linked 
to them, but representing the constraint "these two Idiatinctl nodee do not 
share ate edge In H" * 

For example! given tha graphs G and ft in Figure 3,3 
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G 
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Figure 8.3 


we produce the Constraint network In Figure B. £. 
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Figure 9.4 


(’Tebagatina cbbBtrBknt** u* obtain the rratuerk In Figure #.5, 
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Figure 3„£ 


Ndu additig th* ternary node ua obtain Figure 3.6. 
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Figure 8,6 





Thl-s network, \u relaxed. The ternary node represents the two possible 
ieomorphlane? S-^l, b->2, c->3 and 0-5.2, b-il, c~>2, (The algorithm also 
finds ieonorphic subgraph* along the way.] 

In the above app Meat I fine, the desired global state 1* defined in 
ter*e of local constraints. Often ue firit face an analysis problem; 
choosing, or learning, a sat of local Constraints that specify or 
approximate the deeired global etate ( 281 * (An important concern ui I I be 
the choice of a "goad" constraint expression. i.a. one that can be 
syn thee i zed efficiently.]' As us explore various appl i tat i onn H it ui II . of 
Sour Be, be equally important to a eve I op theoretical set hods for analyzing 
the performance of the algorithm in a given domain. 


3, Consistency and completeness 

The synthesis algorithm operates by rationing higher and higher Javep 
inconeittancies until a global con* latency has been achieved, ]n this 
seetlon* l define thia aepuanca of consistency states, and aieo define a 
concept Of fifitnpletenasa uhich ue ui I I usn( to apply to a network. 

A node Mj of erdar k is k-eonel a tent with a constraint expression C 
if all members of Nj k-aatiafy 0, A network of order ik or greater Is 
S -Cbn* i * f *n t with C if all nodes of order k are k-COneiatent with C. If a 
full constraint network of or Oar n is n-cone 1 s t*n-t with 3 constraint 
expression C Of firdar n wa aSy that it Is coreistent yl th C+ 




A bode Nj of order h is k-c g bjj I e t a for C i f any i net an 11 at i gn aj 
which k-satiefiea C is a lewder of Mj. A network N 1 9 k-eewplftts for C if 
every node of order k ia k-eomplete, An recoup let & full cortatrainl rmluuri 
of Order n ie said to be couplets . 

A fan comments may bo in order to relate the consistency notions 
described in 111 i * section to the background dleoua§«Oh in section 2 . For 
natuarke Of unary and hi nary constraints, k-cdneialency implies that if we 
pick values of any k-1 variables frort the unary nodes, and a k th variable, 
there will he a value of the Mh variable, at the unary made, eueh that the 
k values logo that 1 - satiafy all predicates involving the k variables ti+** 
they fora an Instantiation of Nj where J is the aet of k variables 
chosen], this indicates that l-cor-s i afancy of a constraint network implies, 
node cons I e tency of the correepondiny network of the type deacrlLad in 
eection 2 r 2-contfi 5 tcncy implies arc cone ie fancy and ^-consistency Implies 
path consistency* Ihe firet two are obvious; the latter requires reducing 
path consistency to the three node case. Which is done by induction in a 
theorem of Montanari. 

Suppose we seek a global ablution by lie mg depth firet tree search on 
the elements resaining In the unary nodes of a k-consistent network of 
unary and bimanj constraints, Backup will only be initiated .below the Mh 
levs I 1 If the network Is congi i g ton t, there will be no backup. Even 
hotter, and for arbitrary relaxed constraint networks, we can choose an 
order k node, and nee its- member a as the alternative paths through the 
first k levels of a as arch- tree, only really doing tree search on the 
rang ip ling h-k nodes. Of course, If kb have achieved fuH cone latency the 




msmter* of the order n rods ara the solutions and no further search Is 
required. 


IQ. Synthesis theorem 

Ue a-a non ready to State the theorem uhich justifies the aynthasia 
a Igorithm. 


THEOREM: The relaxation of the network corresponding to A constraint 

express ion C« A t j I S coneiatsiit and epmplste mi lh reaped to C. 

J t2 l 

The Proof Mill be by. induction. Con*latency And co»pleteOssa of order 
one are odv i oui. Dur induction hgpotheeis ia that the network i a 
k-censi Stent and h-completes we ulsh to prove k+i -cons | *t«n C y and 
fe+1-cowpleteneea. 

Consistency! Us uant to sh&u that all flj, far J any cardinal i ty k+i 
auboot of 1, are *+l-tonaiatent. Nj t before relaxation,, corresponded to 
Cj, SO Included nothing which did not satiety CjH relaxation dose not add 
any elements to A node- Suppose there exist* an aj in Nj such that Oj 
does not satisfy C^ t tor hoi™ proper subset H of J, 1,o. Aj nelrletod to 
H Is not a msnber of C^+ Pick 9 set G of cardinality k Such that htaGcJ. 
Because af the local propagation during the relaxation proceii, ue know 
that aj satisfies Thu# rselricted to G. a^ 1 is a fiehber of Ng* As 

the network is k-conal stent a^ restricted to H le a meober of Gut a^ 

reetr 1 oted to H is aj restricted to Hi contradiction. 


far- J any cardinality K+l 


Completeness: Consider any a - rol En Nj. 
subset of 3. Thera Bra tuo po&E- i d i I i t i e a. If Sj uas not in Hj before 
rslaHstion t then does met esti*fy Cj + It aj mSg r*movset during th* 

relaxation process, then ij does not satisfy for some cardinality k 
Subset H of J; by the induction hypothesis a - restricted to H does not 
k-sStisfy C. In either case, Sj doss not k+l-eat i sf y C. 

There are eoweral i*wediats core 11 ar '**, 

Cere Mary it N| corrssponds to tht order n constraint defined by the 
constraint expression C+ 

Corollary 2: C is Batisfiabie If and only if N- is not the etopty sot. 

Corollary 3 f The constraint network cone tree led by the synthesis 
algorithm operating on a constraint expression C is k-consietent with and 
k-cp«plste for C after step k, Ths network constructed by the algorithm >e 
consistent with and complete tor C. and N[ corresponds to C. 


References 


1, Harrow* H,G* and Tercenbaw*. J,H+ HSV&t a eyeteh for reasoning 
about aesnai. Stanford Rs as arch Institute Ail. Center Technical Note 121, 
tlenlo Park, California, April 1976. 

2, Botordw, D. G, and Raphael 9. Mew programmi-ng languages for A.l. 
research. CompuI i na Surveys 6 . 3T1974), 1S3-174* 

3, Chen T C,H. [Ed.l Proceedings of the 1376 Joint Horkshajj on P a ttern 
He td an I t i on a nd Artificia l Intel IIg eftcB . Academic Press, Neu York, in 
preparation. 

4* CIdwob, n.S, On seeing things, Artificial Intelligence 2 . (19719, 
79-116. 

6. Cook, S-A, Ttie complex!ty of |heerais-prov ing procedures, Corf* 
Rec. of 3rd Ann. AQfl Eynp. on Theory of Computing, 1971, 151-159, 

6. Pah!man, S.t. Thesis progress report) a eye tew for representing 
and using real-world kneuiedye, At Hen-0 331, fl*I,T. A, I* Lab,, 1975* 

7. Pikee* H.E* HEP-AFtFi a agate* for solving pr^olnm™ stated as 
procedures. Artificial intelligence 1 , H19793, 27-128, 

8. Hewitt, 6., Bishop Pi and Steiger R, A universal Modular ACT OH 
formalism for artificial intelligence. PrCc+ Third ]nt. Joint Cortf* ort 
A, I, , 1373, pp, 235-245, 

3. Horn, B.K.P. Determining lightnnss froB an linage* Computer 

Graphics and t«ags Processing 3 , 41 Dec, *9741 1 277-299- 

H 

10. Huffman, D,A, Impossible objects »s nonsense sentences, in 
rt*i tzsr t 6, and •flichle, 0, tEde-h rischjne Intelmsense 5 , Edlhburgh LU 











Progs, Edinburgh* 1971* 295-323. 

11. tlackworth, AX. Consistency in networks of relatione. TH 7^-3, 
C, S, Dapt., U, of British Columbia, 1975, 

12. Harr* Q* Simple memory* a theory for arch]cortex, Phil, Tran?. 
Hern. Soc. B. 2S2 . i 19711, 23-81. 

13. Harr. D. and Paggio, T. Cooperative conp.itation of a ter bo 
disparity. A] Itamo 3G4, W. S.T* 4.1. Lad,. 1378* 

14. II inshy H. and Paper t £. Percep Irons . fl. I.T. Praaa, Cambridge, 
Mae a., 19G-8* 

15. flontanarl LI. Natworks of constraint** fundahenta I properties and 
applications to picture proc-BBsing, Information 5c ie nceaJ7 . 2IAprH 1074). 

35-132. 

IS. Roaenfeld, A., Humrre I . R. and Zuchar, S.W. Scene labelling by 
relaxation opera ti png. 1 EEC. .Trane. an _Sm etemn, Man, and Cubarnatics 
STC-6 . 6{June 1376), 428-433. 

)7* Syaensn G, J, end flcDariiott* O'. V. From PLANNER to CQftNIVER -- a 
yenetie approach. Free. AFiPS 1072 P-XC. YdI. 41. AF1P5 Praaa, fbntvale, 
N.J., pp* 1171-1179. 

18. Suae man G.J. and Stallman, R,f1. Antecedent reasoning and 
dependency-directed backtracking in a agate" for computer aided circuit 
analysis. Al Mena in pro grass, II. I.T. A. 3 . Lab. 

19 * Lt I 1 mar * J.R. Aasociating parts of patter ns. Information and 

Control 0 . 6(Dec* 1366], 583-SBi. 

28, (Jllinsn, J,ft* Pattern Recognition Techniques . Crane Rueeak, Now 


York, 1973. 











21 T UHnan, J.R. An alg&rithii fer subgraph i Bohcrph | 8 I*. JhA.C. H, 23 . 
1 Uan. 13761, 31-42, 

22 , Ungiar, S T H, GIT —a hnuristic prog-ran for tasting pairs of directed 
Sine grafjho for i eoaor ph i am. Conn. ACM 7 . 1 [Jan. 1364)* 26-34. 

23. Upiti, D.L* Generating semantic descriptions fnom drawings of 
aeonan wi th sheens. At-ffi-271., ft. |.T, A.I. Lad.* 1372. 

24i Zuefcsr, S + y. Relaxation labelling and the reduction of local 
pmeii^urtlaa. FR-451, C.S. Center, li, of Maryland. 1976. 




